Adaptive Multimodal Fusion
نویسندگان
چکیده
Multimodal interfaces offer its users the possibility of interacting with computers, in a transparent, natural way, by means of various modalities. Fusion engines are key components in multimodal systems, responsible for combining information from different sources and extract a semantic meaning from them. This fusion process allows many modalities to be effectively used at once and therefore allowing a natural communication between user and machine. Elderly users, whom can possess several accessibility issues, can benefit greatly from this kind of interaction. By developing fusion engines that are capable of adapting, taking into account the characteristics of these users, it is possible to make multimodal systems cope with the needs of impaired users.
منابع مشابه
Multimodal medical image fusion based on Yager’s intuitionistic fuzzy sets
The objective of image fusion for medical images is to combine multiple images obtained from various sources into a single image suitable for better diagnosis. Most of the state-of-the-art image fusing technique is based on nonfuzzy sets, and the fused image so obtained lags with complementary information. Intuitionistic fuzzy sets (IFS) are determined to be more suitable for civilian, and medi...
متن کاملAdaptive management of multimodal biometrics fusion using ant colony optimization
This paper presents a new approach for the adaptive management of multimodal biometrics to meet a wide range of application dependent adaptive security requirements. In this work, ant colony optimization (ACO) is employed for the selection of key parameters like decision threshold and fusion rule, to ensure the optimal performance in meeting varying security requirements during the deployment o...
متن کاملAdaptive Multimodal Biometric Fusion Algorithm Using Particle Swarm
This paper introduces a new algorithm called “Adaptive Multimodal Biometric Fusion Algorithm”(AMBF), which is a combination of Bayesian decision fusion and particle swarm optimization. A Bayesian framework is implemented to fuse decisions received from multiple biometric sensors. The system’s accuracy improves for a subset of decision fusion rules. The optimal rule is a function of the error co...
متن کاملA locally-adaptive metric for contrast-fusion of noisy multimodal imagery
We propose a new technique for reducing the effect of noise on contrast fusion of multimodal imagery, yielding higher quality results than can be obtained with previous methods. We rely on local non-parametric estimation of band gradient entropies as a relative measure of geometric structure. This work builds upon previous work by the author, and is exemplified with remote sensing applications....
متن کاملAdaptive multimodal fusion by uncertainty compensation
While the accuracy of feature measurements heavily depends on changing environmental conditions, studying the consequences of this fact in pattern recognition tasks has received relatively little attention to date. In this work we explicitly take into account feature measurement uncertainty and we show how classification rules should be adjusted to compensate for its effects. Our approach is pa...
متن کاملAdaptive Cascade Classifier based Multimodal Biometric Recognition and Identification System
Biometrics consists of techniques for uniquely recognizing humans based upon one or more intrinsic physical or behavioral traits such as Iris, fingerprint, Face and Palm geometry etc. To overcome the limitations of Unimodal biometric system, a multimodal biometric is proposed. Amongst the various fusion levels, feature level fusion is expected to offer better recognition. Feature level fusion f...
متن کامل